DOCUMENT RESUME 

ED 268 664 EA 018 397 



AUTHOR 
TiTLE 

PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Andrews, Richard L.; And Others 

Principal Roles, Other In-School Variables, and 

Academic Achievement by Ethnicity and SES. 

20 Apr 86 

44p.; Paper presented at the Annual Meeting of the 
American Educational Research Association (70th, San 
Francisco, CA, April 16-20, 1986). 
Reports - Research/Technical (143) — 
Speeches/Conference Papers (150) 

MF01/PC02 Plus Postage. 

♦Achievement Gains; Administrator Role; Analysis of 
Variance; Black Students; Disadvantaged; Elementary 
Secondary Education; * Instructional Leadership; 
♦Principals; Regression (Statistics); 'School 
Super? sion; Statistical Significance; *Teacher 
Administrator Relationship; *?eacher Attitudes 
California Achievement Tests; staff Assessment 
Questionnaire 



ABSTRACT 

This 3-year study, part of the Effective Schools 
Project of the Seattle School District and the University of 
Washington, was undertaken to investigate the relationship between 
teachers' perceptions of the principal as instructional leader and 
average gain scores of students in 67 elementary schools in Seattle. 
Scores were disaggregated by student ethnicity and student free lunch 
status as a surrogate measure of socioeconomic status (SES). Data 
pertaining to teacher perceptions of the principal as instructional 
leader were obtained through the Staff Assessment Questionnaire, ani 
specific attention was given to four general aspects of principal 
behavior: (1) mobilizing resource*, (2) communicating, (3) serving as 
instructional resource, and (4) being a visible presence. These data 
were then correlated with school means for aggregated student 
improvement on Total Reading and Total Mathematics of the California 
Achievement Test (CAT). Individual gains for students were computed 
and aggregated for four groups: white, black, free lunch, and 
non-free lunch. Regression analyses were used to assess the 
relationships between the leadership of the principal and other 
effective school characteristics, while analysis of variance was used 
to assess the effects of leadership on student gain seres. The 
findings of this study suggest that teachers' perceptions of the 
principal as instructional leader are critical to the reading and 
mathematics achievement of students, particularly among historically 
low-achieving groups of students. (TE) 
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PRINCIPAL ROLES, OTHER IN-SCHOOL VARIABLES, AND 
ACADEMIC ACHIEVEMENT BY ETHNICITY AND SES 



Perspective 



The school principal slvp has been the subject of hundreds of studies 
over tha past thirty years. The central role of the principal has been 
viewed, variously, as building manager, administrator, politician, change 
agent, boundary spanner, and instructional leader. Principal attributes 
and hypothesized correlates that have been selected for investigation in 
the many studies are in large part derived from value stances concerning 
the relative importance assigned these several roles (Glasman, 1984). 

During the last decade, value stances have tended to center on the 
principal as instructional leader, accountable for the academic' achievement 
of students. Taken collectively, the "effective schools 11 body of research 
studies (see, e.g., Lezotte and Passalacqua* 1978; Frederiksen and Edmonds, 
1979; Edmonds, 1978; Edmonds, 1979a; Edmonds, 1979b; Edmonds and Frederik- 
sen, 1979; Brookover et al., 1979; Brookover and Lezotte, 1977; Weber, 
1971; Lipham, 1981) tends to reflect the view of Sweeney: 



The direct responsibility for improving instruction and learning 
rests in the hands of school principals. Do principals of school: 
witr high achievement exhibit any particular leadership behavior? 
Research suggests that they do. (1982, p. 346; 



The studies of this type tend to examine those schools in which 
achievement levels are high for all students, or where achievement differ- 
ences betweeen subpopulations of students (e.g., low SES vs. high SES) are 
minimal, in attempts to isolate commonalities among in-school variables. 
This approach has been criticized for its emphasis on "outlier" schools 
'Glasman, 19S4; Purkey and Smith, 1982; Purkey and Smith, 1983; Mackenzie, 
1983); others have noted that patterns of principal leadership, commonly 
cited as critical variables in "effective" schools can be observed in 
"ineffective" schools as well (e.g., Wellisch et al., 1978). 

The research described here was undertaken to investigate the relation- 
ship between perc2ptions of the principal as instructional leader and 
average gain scores of students in 67 elementary schools in the Seattle 
School District, with scores disaggregated by student ethnicity and student 
free-lunch status as a surrogate measure of SE5. The study assumes the 
value stance of Sweeney (i.e., the principal as instructional leader, 
responsible for student academic achievement). Further, the study moves 
beyond the limits of the outlier school approach, in that virtually all 
elementary schools were ir^ uded. 

The study is part of the Effective Schools Project of the Seattle 
School District and the University of Washington College of Education. 
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Initiated in 1982, the on-going collaborative project is designed to 
improve all of the district 1 s schools and special programs through a 
var»ety of efforts. These efforts, and the political/social context of 
these efforts, have been described elsewhere in detail (see Andrews and 
Soder, 1995a; Andrews and Soder, 1985b; Andrews, Houston, and Soder, 1985; 
Soder and Andrews, 1984; Soder and Andrews, 1985); therefore, only those 
circumstances bearing on the particular study at hand are presented here. 

Collection, analysis, and provision of data pertaining to 12 quality 
indicators of schools—along with analysis of academic achievement data 
disaggregated by ethnicity, gender, and socioeconomic status—are integral 
elements of the project. One of those quality indicators, as identified 
early on by the district on the basis of an extensive review of the liter- 
ature, is the leadership of the principal. 

A group of College of Education faculty members and district educators 
worked jointly to develop means to assess perceptions of leadership in each 
of the district's schools. Based on further reviews of the literature, the 
means that were developed center on four general aspects of principal 
behavior: (1) mobilizing resources, (2) communicating, (3) serving a' 
instructional resource, and (4) being a visible presence. Each of thesj 
behaviors is described briefly in the sections that follow. 



Mobilizing Resources 

Resource provision may be described as those actions the princiral 
takes to marshal personnel, building, district, and community resources to 
achieve the vision and goals of the school (Torrens and Wing, 1986). 
Resources may be seen as materials (Persell and Cookson, 1982) or as 
information (Schmuck, 1985), with the principal acting as interpreter of, 
and broker for, shared meanings (Sergiovanni , 1984), 



Communicating 

Clear communication of vision is, as Sergiovanni suggests, "purposing" 
--that is, "emphasizing selective attention (the modeling of important 
goals and behavior) signals others of what is of importance and value" 
(1984, p. 7). The literature suggests that principals in high-performing 
schools demonstrate a commitment to goals; they are able to articulate a 
vision of instructional goals as a mechanism for integrating instructional 
planning (see, e.g., Manasse, 1984; Dow and Whitehead, 198C; Gross, 
"iaquinta, and Bernstein, 1971; Blumberg and Greenfield, 1980; Reinhardt et 
al., 1979; Rosenblum and Jastrzab, 1980). 
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Acting as Instructional Resource 

lipham suggests that improvement of teaching and learning is the 
"foremost function of the principal" (1981, p. 12). The principal "is 
actively involved in all aspects of the instructional program, sets 
expectations for continuous improvement and col legial ity, models the kinds 
of behaviors desired, participates in inservice training with teachers and 
consistently gives priority to instructional concerns" (Torrens and Wing, 
1986. p. 18). The importance of the instructional resource role has been 
noted by, inter alia, Sapone (1985), Austin (1979), and Fu'lan (1981). 



Being a Visible Presence 

Walking in the hallways, visiting classrooms, attending departmental or 
grade level meetings, and holding spontaneous conversations with staff 
members and students are examples of being a visible presence. As one 
teacher put it, "He is always around and about the school — in classrooms, 
in hallways, at special events. You see him everwhere. He really knows 
what is going on in this school" (Rutherford, 1985). The visible presence 
role aspect has been noted by, inter alia, Wilson (1982), Brookover et al. 
'1982), Giammatteo (1981), DeBovoise (1972), Murphy, (1983), and Innaccone 
and Jamochian (1985). 

Using these four aspects of principal behavior as the grounding for 
instrument development, draft instruments were devised, tested, and further 
refined. The following section presents a discussion of the methodology of 
instrument development along with a discussion of data sources. 



Data Sources 



The study reported here was begun in 1982 with 67 elementary schools 
and was completed in June 1985. To examine the relationship between the 
staff's perception of strong leadership and (1) student improvement on 
achievement tests and (2) other perceived characteristics of schools, 
several variables were constructed for each elementary school. These 
variables included school means for aggregated student improvement on Total 
Reading and Total Mathematics of the California Achievement Test (CAT), a 
principal leadership scale, and other school characteristics. 
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Academic Achievement 

The CAT was administered to all children by classroom groups in each of 
the schools during April 1982, 1983, and 1984. To be considered as a 
subject in the sample, a student had to be enrolled in the same school over 
the two-year test time. The sample of schools used in the study consisted 
of 33 of the elementary schools where sufficient achievement data were 
obtained to allow for reliable and valid conclusions. Each school had ten 
or more students in each of the disaggregated groups (White, Black, Free 
Lunch, Non-Free Lunch). A listing of schools, leadership score, average 
gain scores, and number of subjects in each group is presented in Appendix 



The improvement measure was constructed tr-m individual student normal 
curve equivalent (NCE) CAT score differences on Total Reading and Total 
Mathematics from Spring 1982 to Spring 1984. Individual gains for every 
stuuent present at the same school during 1983 and 1984 were computed and 
aggregated within schools for all students and by ethnicity, and free-lunch 
status. The year-end 1982 tests provide a reason_jle base for school 
effects over the 1982-84 biennium, regardless whether a student was 
enrolled in the school during 1982. 



Principal as Instructional Leader 

Oata pertaining to teacher perceptions of the principal as instruc- 
tional leader were obtained through administration of the Staff Assessment 
Questionnaire (SAQ). A copy of the SAQ is included in Appendix B" 

Developed collaboratively by practicing teachers and administrators in 
the school district and the University of Washington research team, the SAQ 
consists of 167 Likert-type items measuring nine school factors (strong 
leadership, staff dedication, staff expectations of students, identifica- 
tion of learning difficulties, multicultural education, sex equity, curri- 
culum continuity, learning climate, and frequency of monitoring of student 
progress). Nineteen of the items pertain to the strong leadership factor; 
these items were randomly distributed throughout the instrument. 

Completed SAQs were received from 2,145 teachers in the spring of 1984 
(69i return rate), and 2,303 teachers one year later (74* return rate). 
The Strong Leadership variable was constructed from the 19 Likert items. 
The scale ranged from 19 to 95, with actual mean scores for schools in this 
study ranging from 54.3 to 88.3. 

Reliability of the strong leadership factor was estimated using several 
procedures. In terms of internal consistency, analysis of spring 1984 data 
yielded a Cronbach Alpha of .93. In addition, the SAQ was administered to 
a random sample of 125 teachers in five urban schools, and 139 teachers in 
six rural school districts; Cronbach Alphas of .97 and .93, respectively, 
were obtained. For the principal leadership variable, test-retest reli- 
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ability based on a three-week interval with an N of 30 teachers was .89; 
based on a one-year interval with the same principals in the same schools, 
<H = 63), test-retest reliability was estimated at .723. 



Method 



The SAQ was administered by trained effective schools representatives 
in each school. Data werp gathered at a staff meeting conducted by the 
effective schools representative. All responses were recorded on mark 
sense forms with no subject identification; thus the anonymity of the 
respondent was assured. All data were returned to the research team by 
schools. The Evaluation Services office of the school district optically 
scanned all answer sheets and provided the research team with individual 
items as well as school mean scores on all characteristics. All demo- 
graphic data and student academic achievement were gathered from each 
individual student's master file maintained by the school district. 

As noted earlier, 33 of the original 67 schools had a sufficient 
number of students in each subgrouping to be included in the s.udy. In 
these schools there was a total of 3,515 students included in the data 
analysis. Of these 3,515 students, 1,633 were White, 1,021 were Black, 
1.226 were free-lunch students, and 2,114 were non-free lunch students. 

Current literature is divided on the best measure of improvement in 
academic achievement. Several measures (total scores, individual score, or 
gain scores) could be used to test the relationships hypothesized in this 
study; however, since the primary focus of this study was to examine "value 
adding" from schooling and to examine differential relationships between 
disaggregated student achievement by surrogate SES and ethnicity— variables 
normally held constant in residual gain score analyses, our final analysis 
used student gain scores. The main concern with the use of gain scores as 
measures of improvement is reliability of each individual students score 
'See Cronbach and Ferby, 1970; and Rogosa and Willett, 1983). Sensitive to 
this criticism, we employed a three-step process to examine the relation- 
ship between student academic achievement and our leadership variable. 

School gain scores, prior achievement scores (NCE scores for Spring 
1982 CAT), and NCE scores for Spring 1984 CAT, were used for the data 
analyses. First, multiple regressions were used to determine the strength 
of the leadership score and student achievement gain scores and to assess 
the relationship between the leadership of the principal and other effec- 
tive school characteristics. Regression analyses were used to predict 
spring 1984 NCE scores from prior achievement (spring 1982 NCE scores) and 
the leadership of the school principal variable. Where no significant 
relationship was found between prior achievement and spring 1984 NCE 
scores, simple regressions were used to estimate the relationship between 
the leadership of the principal and gain scores. Analysis of variance was 
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used to assess the effect of the leadership treatment condition on gain 
scores in both Total Reading and Total Math. 

The procedures used in this study have minimized the impact of the lack 
of reliability in gain scores by aggregating individual student gain scores 
to an average school gain score. The eliminatic of schools with less than 
10 students in any subgroup results in averages less sensitive to the 
vagaries of testing. The correlation between individual 1982 and 1984 CAT 
scores for all students in the same school for the project period was .7 , 
for Reading and .73 for Math (p < .001). 

Specific hypotheses tested in the study were that children who have 
attended schools that were administered b» principals who were strong 
instructional leaders would have (1) significantly greater increases in NCE 
scores for total reading and total mathematics than would children who have 
attended schools where principals are not strong instructional leaders; and 
(2) the leadership of the principal would be significantly related to other 
school variables. 



Results 

The results from the regression analysis are presented in Table 1. 

As can be seen in Table 1, these multiple regression analyses predict 
1984 CAT scores on the basis of 1982 CAT NCE scores and the leadership 
variable. Using the school as the unit of analysis, separate regressions 
were run using the same schools with different subsets of their popula- 
tions. No school had less than 10 students in any of these subgroupings 
(Black, White, Free Lunch, No Lunch). These analyses suggest that 1984 NCE 
scores are strongly related to 1982 gain scores for all subgroups except 
Blacks in Reading and Math. These analyses simply confirm that on the 
school level and individual level, in most cases the best predictor of 
future level of achievement is prior achievement. 

In those cases where prior achievement is significant (all cases except 
for Black students), positive coefficients for the principal leadership 
variable indicate that this variable accounts for additional variation in 
school averages. Coefficients significant at the .05 level were obtained 
for all students (Reading and Mathematics), free-lunch students (Reading 
and Mathematics), and White students (Reading). 



0 

ERJC 



8 



7 



Table 1 

Multiple Regressions with 1984 Scores as Dependent Variable 



Sroup Type Constant 1982 Score Leadership P.? (F Stat) 



Overall 


Reading 


6.12 




.757 ** 


.146 * 


.72 ** 


(coefficients) 


{ O.C/D) 




(.Uo/o ) 


(.b/lU ) 


/An o 

(42.2 


(Standard error) 












White 


Reading 


4.65 




.791 ** 


.157 * 


.85 ** 








( 




(.0638 ) 


/ c o cox 

(88.52) 


Black 


Reading 


27.67 ** 




.379 


.061 


.12 






Ml CA \ 

(11. 04 ) 


( 


.1865 ) 


(.0799 ) 


( 2.12) 


free Lunch 


Reading 


7.55 




.638 ** 


.177 * 


.37 ** 








( 


.1703 ) 


/ moo \ 

(.0709 ) 


/ O TO \ 

( 8.78) 


No Lunch 


Reading 


8.01 




.766 ** 


.134 


.73 






( 7.1 ) 


( 


.0896 ) 


(.06793) 


(40.41) 


Overall 


Mathematics 


7.87 




.612 ** 


.236 * 


.44 ** 






(11.18 ) 


( 


.1728 ) 


(.0896 ) 


(11.69) 


White 


Mathematics 


2.21 




.784 ** 


.180 


.60 






(10.35 ) 


( 


.1301 ) 


(.1090 ) 


(22.40) 


31ack 


Mathematics 


31.34 * 




.186 


.149 


.09 






(12.48 ) 


( 


.1667 ) 


(.087^ ) 


( 1.527) 


Free Lunch 


Mathematics 


11.38 




.447 ** 


.27U * 


.37 ** 






(10.23 ) 


( 


.1544 ) 


(.0837 ) 


( 8.99) 


No Lunch 


Mathematics 


11.28 




.614 ** 


.209 


.41 ** 






(11.93) 


( 


.1571 ) 


(.1126 ) 


(10.76) 



* Significant beyond the .05 level 
** Significant beyond the .01 level 
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As further indicated in Table 1, 72 percent of the variance in reading 
was accounted fo- by prior achievement (1982 NCE score) and the leadership 
of the principal. The disaggregated analysis suggests that as much as 85 
percent of the variance of White student achievement is accounted for by 
these variables; however, when controlling for 1982 NCE scores in reading 
and mathematics for Black students only, 12 percent and 9 percent of the 
variance, respectively, was accounted for i.i 1984 NCE scores. 

The absence of significance for the coefficient for 1982 CAT scores 
for Blacks in both reading and m.»th suggests that it is appropriate to 
examine the relationship between these students and their ga^n scores 
without controlling for the prior achievement (1982 NCE scores). It 
appears that, aggregated to the school level, prior achievement is not as 
important for Blacks as it is for other groups. Thus, in Table 2 are 
presented simple regressions for Blacks using only the leadership variable. 



Table 2 

Simple Regression with Gainscores as the Dependent Variable 



Group Type Constant Leadership R2 (F Stat) 

Black Reading -6.25 .1200 .05 

(6.49) (.0898) ( 1.76) 

Black Mathematics -22.93 ** .3350 ** .25 ** 

(7.47) (.1033) (10.500) 

** Significant beyond the .01 level 



As can be seen in Table 2, a significant relationship was found between 
Black student gain score in mathematics and the leadership of the principal 
(R^ = .25; p < .001). However, no significant relationship was found between 
the leadership of the principal and Black student gain scores in reading. 

The coefficients in the regression analysis, while helpful in our 
understanding of the relationship among the variables, have little prac- 
tical application in our understanding of the larger construct of strong 
leadership. It is difficult to meaningfully interpret 1-point changes in a 
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scale treated as a continuous variable. Thus, in an additional step in 
analyzing the nature of the relationship between the leadership of the 
principal and student gain scores, a discrete leadership variable was 
created from the continuous leadership scores. 

The 33 schools were divided into three equal groups of schools based 
upon the principal leadership variable score. The highest scoring within 
this group were labeled strong leaders and the lowest scoring were labeled 
weak leaders. In this manner it is easier for us to gauge at the applied 
level the magnitude of effects that are being measured. Analysis of 
variance was used to determine any significant differences in gain scores 
of students based upon the three groups of principals. In addition, the 
grouping provided a convenient way to illustrate the homogeneity of the 
populations served by the schools in all groups. 

The three groups, based on the rating of principals by the teachers in 
the school o.i strong instructional leadership, were Strong Leader, X = 
80.4; Average Leader, X = 72.2; and Weak Leader, X = 62.9. Schools in each 
group were comparable in size, percentage of ethnic minority children, and 
percentage of children participating in the free-lunch program. The mean 
leadership score for each group was approximately one standard deviation 
higher or lower than its next nearest leadership group. The Total Reading 
and Total Math average NCE scores at the beginning of the study are 
presented in Table 3. 

As can be seen in Table 3, there were no significant differences 
between the various groups of schools in the mean scores for all students 
in Total Reading (p < .533) and Total Math (p < .453) scores. For example, 
the mean score for Total Reading of students in schools that had principals 
who were strong instructional leaders was 53.73, average leaders 56.95, and 
weak leaders, 53.81. The mean Total Mathematics scores were 56.13, 57.72, 
and 54.93, respectively for the Strong Leader, Average Leader and Weak 
Leader groups. 

When the data were disaggregated by ethnic groups, there were no 
differences between the three Leadership Groups. There were no significant 
differences when children within these schools were grouped by ethnic group 
'Black or White) or for surrogate SES (Free Lunch or No Free Lunch). 
Howeve/, when compared within groups, there were differences between the 
average achievement for Total Readinq of White students (63.20) and Black 
students (46.96), and for Total Math of White students (62.62) and Black 
Students (45.17). However, these differences were consistent across the 
three groups of schools when the study began in 1982. A similar dispropor- 
tionality can be observed in the Total Reading and Total Math scores when 
disaggregated by the Surrogate SES measure (Free- or No-Free-Lunch Status), 
Free Lunch students scored on the average 14 to 16 NCE points below their 
more affluent counterparts. On the other hand, there were no significant 
differences between the three leadership groups of schools when compared on 
their NCE scores at the beginning of the study. 
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Table 3 

Summary of 1982 NCE Mean Scores for Total Reading 
and Total Mathematics by Groups 



^roup and 
Test Score 



Leader Group 



All Schools 



Strong 
Leader 



Average 
Leader 



Weak 
.eader 



F Test 



Significance 



Ml Students 

Ethnic Groups 

White 
Black 



1982 READING CAT NCE 
54.83 53.74 56.95 



63.20 
46.6) 



63.36 
45.97 



65.25 
47.75 



53.81 



62.00 
47.35 



,533 



.533 
.218 



Surrogate SES 

No Lunch 
Free Lunch 



61.34 
45.17 



61.21 
44.15 



63.14 
46.56 



59.68 
44.80 



.367 
.471 



1982 MATH CAT NCE 

<U1 Stujents 56.26 56.13 57.72 54.93 .453 
Ethnic Groups 

Whit e 62.62 62.32 64.58 61.06 .459 

B1 *ck 47.79 46.11 48.95 48.27 .308 



Surrogate SES 

Ao Lunch 61.75 52.6b 62.68 59.73 

Free Lunch 47.68 47.01 49.05 46.98 



.308 
.635 
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The lisulcing mean scores and significance of F-tests f rom the analyses 
of variance using leader group as the independent variable and average gain 
scores 3* the dependent variable are presented in Table 4. 

As can be seen in Table 4, the results of the ANOVA for Total Reading 
gain scores suggest that there were signficant differences between the 
three groups of schools (F = 4.35; p < .017). Using the Tukey (a) proced- 
ure for testing differences between simple mean scores resulted in the 
following conclusions: (1) Students in sc!-.oo;s administered by principals 
who were rated by their teachers as strcg instructional leaders had 
significantly greater gain scores in Total Reading (X = 4.40) than did 
students in schools administered by principals rated as average (X = 1.57) 
or schools administered by principals rated as weak (X = 1.82); 
<2^ Students in schools administered by principals wiio were rated by their 
teachers as strong instr, onal leaders had significantly greater gain 
scores in Total Reading for students who received free lunches (F = 6.05; 
p < .003). The Tukey (a) procedure resulted in the contusion that free- 
lunch children who attended schools that were administered by principals 
who were strong leaders had significantly higher gain scores (X = 5.87) 
than did their counterparts who attended schrols administered by average 
principals (X = 2.00), or schools administered by weak principals (X = 



The disaggregated achievement analysis suggested that for all subgroups 
there were wide variations in the gain scores of students. All subgroups 
of students' acMevement was positive in the direction of the students in 
school administered by strong instructional leaders. For Black student 
Total Reading gain scores, Black students in Stiong Leader schools gained 
an average of 4.57 points compared to 1.38 and 0.92 for the average and 
weak groups, respectively; these differences were not sufficient to achieve 
the .05 level of significance. 

The results of the ANOVAs for Total Math gain scores -vere similar to 
those in Reading. However, a greater number of significant differences 
were found. Significant differences were found for Total Math gain scores 
fF = 3.52; p < .034); white student gains (F = 3.60; p < .039); Black 
student gcins (F = 6.50; p < .009); and free lunch student gains (F = 5.93; 
p < .005). The results from the Tukey (a) analyses found the differences 
in favor of the students in schools administered by principals who were 
«-t,-ong instructional leaders. The most significant gains were for Black 
students (,( = 4.43) and free lunch students X = 5.97) in Strong Leader 
schools. While Black students attending schools with principals with 
strong leaders gained on the average 4.43 points over the two-year period 
of time, black students in schools administered by weak leaders lost on the 
average 2.34 points over the two-year period of time. Poor students gained 
an average of 5.97 points in schools ad.^inistereo by strong leaders, and 
lost on the average of .09 points during the same perioo of time in schools 
administered by weak leaders. 
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Table 4 

Reading and Math Two Year Gain Scores 
(1982-1984) by Group 



Group and 
Test Score 



L eader Group 



All Schools 
(n=33) 



Strong Average Weak 
Leader Leader Lead er 
TPTTT (n=ll) Tfi^TTT 



F-Test 



Significance 



All Students 

Ethnic Groups 

dhite 
Slack 

Surrogate SES 

No Lunch 
Free Lunch 



TOTAL READING GAIN 1982-194 
2.72 4.80 1.57 1.82 



2.b3 
2.37 



2.92 
3.00 



4.34 
4.80 



4.78 
5.87 



1.80 
1.48 



1.90 
2.00 



..47 
.92 



2.10 
1.10 



.017 * 



.104 
.055 



.093 
.003 ** 



TOTAL MATH GAIN 1982-1984 

.1 Students 1.75 4.45 -.405 1.21 .035* 
Ethnic Groups 

White 1.06 3.50 -1.88 1.53 .039 * 

Black 1.14 4.43 1.34 -2.34 .009 ** 

Surrogate SES 

No Lunch 1.48 3.78 -.93 1.60 .142 

Free Lunch 2.24 5.97 .83 -.09 .005 ** 



* = Significance beyond .05 level. 
** = Significance beyond .01 level. 
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The final analysis of this study was designed to examine the relation- 
ship between the strong leadership variable and other school sta f f 
variaoles measured in the study. In addition to the strong leadership 
variable, eight additional variables are measured with the staff question- 
naire. The correlations between these staff variables and the strong 
leader variable are presented in Table 5. 



Table 5 

Interconnection Matrix of Strong Leadership and Early Identification (IDi; 
Frequent Monitoring of Student Progress ^FRMN); 
High Expectations (HIEX); Multicultural Education (MUCU); 

Positive Learning Climate (PLCT); Sex Equity (SXEQ); 
Curriculum Continuity (CUCO); and Dedicated Staff (DEDSTF). 



ID FRMN HIEX MUCU PLCT SXEQ CUCO DEDSTF 



Strong 

'.eader .31* .75*** .40** .40** .64*** .53*** .24 .255 



* Significant beyond .05 level 
** Significant beyond .01 level 
*** Significant beyond .001 level 



As can be seen in Table 5, the leadership of the principal was related 
to si v of the eight variables. The leadership of the principal was not 
significantly related to curriculum continuity (R = .21) and staff dedi- 
cation (R = .25). The variables most highly related to strong leadership 
were those identified by Edmonds— namely, Positive Learning Climate 
(R = .64, p < .001); Frequent Monitoring of Student Progress (R = .73, p < 
.001); and High Expectations (R = .40; p < .01). Other variables related 
to climate and equity issues in thh study were significant: Staff Percep- 
tion of Sex Equity issues (R = .53; p < .001); Multicultural Education 
( R = .40; p < .01); and Ear"iv Identification of Learning Difficulties 
(R = .31; p < .05) 
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Implications 



The findings of this study suggest that perceptions of the principal as 
an instructional leader are critical to the reading and mathematics 
achievement of students, particularly among historically low-achieving 
groups of students. To the extent that we value the principal as an 
instructional leader— and to the extent that we value improved academic 
achievement of all students—the findings have major implications for 
educational policy. 

Before discussing these implications, the need for additional research 
shoulJ be noted. Qualitative analyses are currently being conducted by the 
research team to determine the particular sets of behaviors (beyond the 
general areas of mobilizing resources, communicating, serving as instruc- 
tional resource, and being a visible presence) that are associated with 
Strong Leader principals. The findings from these analyses will contribute 
to the formulation of specific recommendations and the conduct of further 
research. 

In terms of general policy development, however, the findings from the 
current study suggest implications for four areas: (1) preservice trainina 
of principals, (2) selection of principals, (3) continuing education of 
principals, and (4) evaluation of principals. 



°reservice Training 

To the extent that certain behaviors of principals are associated 
wi'h improved academic achievement of all stude.its, those behaviors should 
provide a primary focus for principal preservice training programs. The 
predictive validity of admissions criteria should be examined in light of 
study findings. Desired behaviors should be reinforced during training 
programs, and should be an integral part of training program exit criteria. 



Selection of Principals 

School districts should review their selection criteria for principals 
in light of the study findings and in terms of their obligations to provide 
quality education programs for all students. The findings clearly suggest 
a relationship between principal behaviors and academic achievement. 
Criteria to predict these behaviors should become a fundamental part of the 



16 



15 



selection process. At the same time, these criteria should be made expli- 
cit to those responsible for preservice training. Careful articulation is 
necessary to maintain a sufficient pool of applicants who meet the criteria 
and to minimize the need for retraining of newly selected personnel. 

It can be seen that the preservice training programs in higher educa- 
tion and the school districts both have responsibilities for the selection 
of principals. As such, the delineation of selection criteria is a task 
involving an often delicate and tenuous relationship between two institu- 
tions. School districts should not see their task as dictating the 
specific nature, scope, and procedures of any given principal training 
program. At the same time, it must be recognized that districts have an 
obligation to select principals in accordance with specified needs, and 
training programs should, within normally accepted professional stardards, 
e responsive to those needs. 



Continuing Education 

Systematic application of relevant selection criteria should, over a 
period of a few years, result in a high level of congruence between a 
school district's expectations for principals and the behavior of those 
newly selected. Virtually all school districts, however, are in non- 
original situations, with principals already in place and principal turn- 
over rates relatively low. In such instances, school districts should 
examine their continuing education programs to ensure that the desired 
principal behaviors are reinforced. 



Principal Evaluation 

Many school districts are wont to adopt edifying goals for principals, 
hut then proceed to evaluate principals on bases unrelated to those goals. 
In light of the findings of this study, school districts should examine 
their formal processes for evaluation of principals. Expectations for 
desired behaviors should be made explicit, and should become uie funda- 
mental basis for principal evaluation. 

'i60)6R 
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Individual School Data: Reading 
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Individual School Data: Math 
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THE SCHOOL "ASSESSMENT QUESTIONNAIRE 
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'This instrument is designed to provide you the opportunity to express your 
Opinions about your work and various ideas you may have about your school. 
There are no right or wrong responses, so do not hesitate to mark the 
statements frankly. 

A separate answer sheet is furnished for your responses. Fill in the 
information requested on the answer sheet. You will notice there is no 
place for your name. Please DO NOT record your name. All responses will 
be strictly confidential and results will be reported by groups only. 
PLEASE DO NOT OMIT ANY ITEMS. — - 



rt 



DIRECTIONS FOR RECORDING RESPONSES ON YOUR ANSWER SHEET: 



Read each statement carefully. Then indicate whether you Strongly 
Agree (A), Agree (B) , are Undecided (C), Disagree (D), or Strongly 
Disagree (E) with each statement. Mark your answers on the mark 
sense form provided in the following manner: 



SA A U 
ABC 



D 
D 



SD 
E 



If you Strongly Agree with the statement, blacken 
space A. 



()()()() 



If you Agree with the statement, blacken space B. ( ) (M) ()()() 
If you are unsure or Undecided! blacken space C. ( ) ( ) #4 ( ) ( ) 



If you Disagree with the statement , blacken 
space D. 

If you Strongly Disagree! blacken space E. 



<)()()*»() 

()()()() M 



All marks should be heavy and completely fill the answer space. If 
you change a response, erase the first mark completely. Mae no stray 
marks on the answer sheet. Please do not mark this booklet. 
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NOTE: Items marked with an asterisk pertain to the Strong Leadership 
dimension. 



TEACHER ASSESSMENT QUESTIONNAIRE 



CO 



Q 



O CO 



1. Drug and alcohol abuse are problems in this 
school . 

2. My principal encourages the use of different 
* instructional strategies* 

3. What I teach in my class contributes to the con- 
tent of the grade or course that follows it, 

4. I enjoy working *x this school, 

5. Staff members assume responsibility for 
discipline in my school, 

6* Problems in this school arc recognized and 
worked on, 

7. My principal promotes staff development activi- 
ties for faculty. 

8. I feel there are procedures open to me to go to 
a higher authority if a decision has been made 
that seems unfair. 

$• Discipline is not a problem in my school. 

10. My princip* 1 uses direct observation in forming 
judgments about my performance. 

11. Our school has a set of goals that everyone 
understands. 

12* Students can count on staff members to listen 
to their side of the story and be fair. 

13. The atmosphere of our school is responsive to 
cultural, ethnic, and language differences. 
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14. The curriculum of our school ie multiethnic 



A B C D E 



and multicultural. 


( ) ( 


>')()() 


The physical condition of my school is 
generally pleasant and well-kept. 


( ) ( 


><><><> 


School rules are enforced equally for everyone. 


C ) ( 


)()()(> 


Teachers and staff members take a real interest 
in their students' future. 


( ) ( 


'<>(>(> 


My principal is an active participant in 
staff development. 


C ) ( 


)()()(> 


I rely heavily on teaching materials that I 
develop myself for classroom lessons and 
activities. 1 


C ) ( 


)()()(> 


People are clear about their rights and respon- 
sibilities in my school. < 


[ ) ( 


)()()(> 


Teachers in my school turn t« the principal with 
instructional concerns or problems. ( 


: ) ( 


)()()(> 


Assemblies and special activities at our school 

reflect the ethnic and cultural diversity in 

the Seattle community. ( 




)()()(> 


Staff members of our school are sensitive to 
ethnic and cultural differences. ( 


■ > ( 


)()()(> 


Wh^t I teach in my class builds upon the content 

of the grade or course that precedes it. ( 


> ( 


)()()(> 


The administrators of my school are responsive 

to students 1 needs. ( 


> ( 


)()()(> 
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27. 



^29. 



30. 



* 3'- 



32. 



33. 



^34. 
5^35. 



36. 
37. 



Discussions with my principal result in 
improved instructional practice. 

The goals/objectives the district specifies 
for my courses or grade level are appropriate. 

My principal leads formal discussions concerning 
instruction and student achievement. 

My principal uses clearly communicated 
criteria for judging my performance. 

People in my school are willing to listen to 
the ideas and feelings of others, even when 
they disagree. 

My principal is knowlec geable about 
instructional resources. 

Bulletin boards and other displays in our 
school reflect ethnic and culture pluralism. 

Our school's staff examines instructional 
materials for ethnic and racial bias. 

My principal makes' frequent classroom 
observations . 

My principal mobilizes support to help achieve 
academic goals. 

A positive feeling permeates this school. 

There is a lot of encouragement and personal 
support among people at school. 
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29. 
40. 

41. 



43. 



44. 



45, 



46. 



My principal provides a clear vision of what 
our school i? all about. 

Students in my school abide by school rules. 

What I teach in ipy class is basically the 
same as classes like mine in other schools 
in the district. 

Students are given meaningful ways of being 
involved in the leadership of the school. 

My principal's evaluation of my performance 
helps rse improve my teaching. 

The goals/objectives the district specifies for 
my courses or class are important. 

Staff at our school has high expectations 
of academic achievement for students of all 
ethnic groups. 

Our school has an atmosphere that encourages me 
to express my ideas. 

Our school's curriculum helps students view 
ideas from diverse ethnic perspectives and 
points of view. 



47. The school rules are fair. 
48. 



49. 



Student behavior is generally positive at my 
school. 

My principal communicates clearly to me 
regarding instructiona 1 . matters. 



A B C D E 

()()()()( 
()()()()( 

()()()()( 
()()()()( 
()()()()( 
()()()()( 

()()()()( 
()()()(>( 

()()()()( 
()()()()( 

()()()()( 

()()()()( 
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50. Discipline is fair and related to violations 
of agreed-upon rules. 

51. The classroom atmosphere in my school is 
conducive to learning for students. 

52. My principal is an important instructional 
resource person in our school. 

-j^- 53. My principal is accessible to discuss matters 
dealing with instruction. 

54. Stealing is a problem in this school. 

53. District curriculum documents guide my planning 
of instruction. 

56. Vandalism is a problem in my school. 

57. My principal respects my time as a scarce 
resource. 

58. My principal is a "visible presence 11 in our 
building to both staff and students. 

59. Staff and students do not view security as an 
issue in my school. 

60 District adopted textbooks guide my planning 
of instruction. 

61. I feel satisfied with my students 1 progress in 
school • 

62. Our school provides its students with a strong 
multiethnic Multicultural education. 
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63. I have a chance to present ideas when important 
decisions are made about programs in this school* 



64. The atmosphere of our school is responsive to 
gender differences* 

63. Our school's staff examines instructional 
materials for sex bias* 

66* Students cut a lot of classes. 

67. Achievement test results guide my planning of 
instruction* 

68. The teaching styles in our school are sensitive 
to the ethnic and cultural diversity of our 
students. 

69. My principal is an effective disciplinarian. 

70 Staff at our school has the same expectations 
of academic achievement for both female and 
male students. 

71. I teach basically the same content that is 
taught in other classes of the same grade 
or same course at my school. 

72. This sihool makes students enthusiastic about 
learning. 

73. I would transfer to another school if I could. 

74. The content the district specifies for my 
courses or class is appropriate. 




75. Our school's curriculum helps students view 
ideas from both male and female perspectives. 

76. My principal provides frequent feedback 
regarding my classroom performance. 

77. The tests I de op guide my planning of 
instruction. 

78. The teaching sLyles in our school are sensitive 
to the needs and concerns of both sexes. 

79. I am satisfied with the variety of extra- 
curricular activities at this school. 

80. Procedures used to motivate students are fair 
Co both sexes. 

81. Teachers know and treat students as individuals. 

-^"""82. My principal assists faculty in interpreting 
test results. 

83. My school building is neat, bright, clean and 
comfortable . 

84. The content the district specifies for my 
courses or grade level is important. 

85. My school is a safe and secure place to work. 

86. Staff members of our school are sensitive to 
the needs and concerns of both sexes. 

87. There is little sexist behavior among staff 
at our school. 
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90. 



94. 
95. 
96. 



c 



My principal is a strong instructional leader. 


( ) ( ) 


( ) c 


) ( ) 


Our staff works best when it has ? set of rules 
to follow. 


( > < ) 


( ) ( 


) ( ) 


The district has too much control over our 
inservice training. 




( ) ( 


) ( ) 


Students with special learning needs in my 
class are not receiving the instructional 
program they need. 




t \ * 
\ ) V 


) ( ) 


My school has effective programs for students 
who are in need of remediation. 




( ) ( 


) ( ) 


Multiple assessment methods are used to assess 
student progress in basic skills (e.g., 
criterion— referenced tests, work samples, 
mastery checklists, etc.) 




( ) ( 


) ( ) 


My school has programs for students who are 
high achievers. 




( ) c 


/ ( ) 


Staff in our building want more control over 
the resources they need to do their jobs. 




( ) ( 


) ( ) 


Student assess nent information (such as 
criterion-referenced tests, skills checklists, 
etc.) is regularly used to give specific student 
feedback and plan appropriate instruction. 




( ) ( 


) ( ) 


The district wants us to use more individual 
judgment in diagnosing student learning needs. 




( ) ( 


) ( ) 


I expect most students in my school will 
perform below the national average in 
academic achievement. 




( ) ( 


) ( ) 
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99. No challenge is too tough for our staff. 

100. Every student should be a unique challenge for 
our staff. 

101. My principal has given me a clear understanding 
of my responsibilities regarding District 
homework policies and procedures, 

102. The principal in my school is aware of student 
progress in relation to instructional objectives. 

103. We do not have enough opportunity to exercise 
our own judgment outside the classroom. 

104. Most students in my school are capable of 
mastering grade level academic objectives. 

105. The district doesn't listen when we tell them 
our problems* 

106. I expect most students in my school will perform 
above national average in academic achievement. 

107. The academic ability of students in my school 
compares favorably with students in other 
schools. 

108. Our staff does not* want to make decisions about 
matters that do not affect our classrooms. 

109. The district is not aware of the good work 
we do. 

110. If a person in the building runs into trouble, 
someone helps him or her out. 



u 



i 

•rA 

3 



.2 
o 



.a h 



4 



111. People in our building seek out training 
experiences Chat increase their ability to 
educate students. 

112. Staff in our building have a great deal of 
trust. 

113. People in this building are willing to help 
out wherever they are needed. 

114. Staff .a our school are proud of what they do. 

115. Nearly all of my students will be at or above 
grade level by the end of this year. 

116. If staff motivation is a problem, the district 
wants us to deal with it. 



117. The district wants us to be more goal-oriented. 

118. People in our building work hard to maintain 
good relations with parents. 

119. The judgment of fellow staff members should count 
more than the judgment of others in performance 
evaluations • 



120. The district wants us to be more colleague- 
oriented. 



121. Mosc of my students wi-1 show at least one year's 
growth in academic achievement this year. 

122. Morale is best when staff sticks with familiar 
routines • 



123. Staff in this building tries to do everything 
the district wants. 

4 
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124. Every member of our staff should have to obey 
the same set of rules. 

125. The district asks for too much information. 

126. The district respe.fs ideas which come from 
building staff. 

127. The district wants us to put the we 1 fare of our 
students ahead of our own welfare. 

128. The district thinks most problems are best 
solved by principals and faculty at the 
building level. 

129. Teachers should determine and set standards 
for the profession. 

130. Many of my students p-obably will leave s hool 
before high school graduation. 

131. Criterion-referenced tests are used to assess 
basic skills throughout th<; school. 

132. Teachers in my school generally believe most 
students are able to master the basic reading/ 
math skills. . . 

133. Our principal treats teachers as colleagues. 

134. School staff should try to have more influence 
over educational policy in this state. 

135. The district does not want us to participate 
in important policy decisions. 



ABODE 
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B C 
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136. 


I communicate to my students a clear under- 
standing of their responsibilities regarding 
homework assignments. 




( ) ( ) 


( ) 


< ' 


137. 


Staff in our building are loyal employees. 


o 


( ) ( ) 


( ) 




138. 


The best id^as in our building come from our 
teachers. 


( ) 


( ) ( ) 


( ) 


<> 


139. 


I regularly follow district procedures for 
assigning homework. 


( 


( ) ( ) 


f \ 


<> 


140. 


Staff members should refuse to do things that 
are not good for students • 




( ) ( ) 


( ) 


< ' 


141. 


The principal uses test results to recommend 
changes in the instructional program. 




( \ ( \ 


( ) 




142. 


Most of the important planning in our school 
should be done by building staff. 




\ ) \ ) 


( ) 
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The district can count on us to give our best. 


( ) 


( ) ( ) 


( ) 




144. 


Present district rules and regulations do not 
give staff enough protection* 


( ) 


( ) ( ) 


( ) 




145. 


My school is responsive to students with special 
learning needs. 




( ) ' ) 


( ) 




146. 


We do not get the respect we deserve from the 
district. 




( ) ( ) 


( ) 




147. 


My school has effective procedures for iden- 












tifying students with special learning needs. 




( ) ( ) 


( ) 


( ) 


148. 


We are committed to working together as a 












faculty. 




' ( ) 


( ) 


( ) 
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149. The district does not know what is going on 
in schools. 

150. Our staff constantly looks for ways to do a 
better job. 

151. Cur staff holds itself to the highest pro- 
fessional standards. 

152. The district wruld rather have a loyal staff 
than a competent staff. 

153. The district would be happier if teacher and 
principal organizations did not exist. 

154. Staff in our building want to be told what to 
do and how to do it. 

155. Most students in my school will perform 
at about the national average in academic 
achievement. 

156. Teachers in other schools would rate my 
school's level of academic achievement as 
good. 

157. Most of the students in my school will 
ultimately graduate from high school. 

158. Whatever it takes, peop e in our building solve 
problems. 

159. We are ready to learn to do our jobs in a new 
way if it will meet the needs of students. 

160. The district treats us like children. 
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1 £ 1 

L6L. 


Professional achievement is recognized and 
rewarded in our building* 


( ) 


( 


) ( 


) ( ) ( ) 


1 


162. 


We ha^e a strong sense of community ; - our 
building* 


( ) 


( 


) ( 


^ ( \ ( \ 
i \ ) \ ) 


t 


163. 


Staff in this school really care about how 
much students learn. 


/ - \ 
\ / 


( 


) ( 




t 


164. 


Staff review and analyze test results to plan 
instructional program changes. 


( ) 


( 


) ( 






165. 


Our staff wants the principal and district to 
plan for our inservicc learning needs* 


( } 




) ( 




• 

! 


166. 


Teacher.* in my school frtqaently asses* the 
progress of students ii basic skills. 


( ) 


( 


) ( 




i 


167. 


Homework assigned in my class helps students 1 
academic progress • 


( ) 


( 


) < 
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